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METHOD TO ESTIMATE THE WHITE POINT ON A DISPLAY DEVICE 

BACKGROUND 

The present invention relates to the field of 
5 digital image processing, and more particularly to color 
calibration and color enhancement for digital imaging 
systems . 

Continual advances in computer technology are 
making possible cost effective color digital imaging 

10 systems capable of displaying high resolution images. 
The proliferation of these imaging systems is driving a 
need for predictable color matching between the image 
scanner, the display, and the hard copy devices. In 
color digital imaging, each aspect of the imaging chain, 

15' including the lighting of the original scene as well as 
the capturing, storage, transmission, and display of the 
image on screen or hard copy devices, generally involves 
different color spaces in conjunction with different 
color gamuts. Most of the color spaces are device 

20 dependent. A color gamut is the range of colors which 
can be reproduced on a particular device. In this 
context, accurate descriptions of how various devices in 
a typical work flow represent color are required. 
One method to ensure consistent color 

25 characteristics is to calibrate the color display and 
hard copy devices to particular set up parameters. A 
description of a device with respect to the way it 
represents color is stored in a "profile" of that device. 
Based on the type of the device, certain param.eters are 

30 required in order to characterize the device completely 
and accurately. For example, in the case of display 
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devices, these parameters include the X, Y, and 2 
coordinates of the media white point; the relative X, Y, 
Z values corresponding to red, green and blue; and the 
5 red, green and blue tone reproduction curves. The XYZ 
values are the three standard primary colors of the CIE 
chromaticity diagram. Once all devices involved in a 
particular work flow are appropriately characterized by 
the corresponding profiles, color management systems can 

10 be used to convert colors from the color space of one 
device to the color space of another device, therefore 
leading to consistent color reproduction across the 
devices as well as operating system platforms* 

Several products are currently available for 

15 accurately measuring the characteristics of various 
display and hard copy devices. With the aid of such 
tools, the user can display an image having known color 
characteristics and manually calibrate the display screen 
to produce known characteristics of the image on a 

20 display screen or on a hard copy device. However, since 
most computer users do not have access to relatively 
expensive measurement and calibration equipment, these 
users generally resort to an alternate solution of using 
a software tool in conjunction with a physical template 

25 whose brightness and hue are compared and matched to that 
of the display. However, the use of the matching 
template is not optimal as the screen and the template 
are made from different media (emissive versus 
reflective) . Additionally, software tools in this 

30 category require that a template be readily available for 
comparison purposes. 

SUMMARY OF THE INVENTION 
The invention provides apparatus and methods 
implementing a technique for estimating the white point 
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of a display device. 

In general, in one aspect, the technique includes 
displaying a plurality of grey patches on a screen; 
5 requesting that a user select a patch corresponding to a 
neutral grey; and iteratively converging to a patch where 
the estimated white point is the most neutral grey point. 

In general, in another aspect, the technique 
includes displaying an image on a screen of a display 
10 device, and deriving an estimate of the white point of 
the display device solely on the basis of a user's 
response to the displayed image and without comparison to 
an external reference, the estimate of the white point 
being the coordinates of the estimate on a chromaticity 
15 diagram. 

Advantageous implementations of the invention 
include one or more of the following features. Gamma and 
phosphor values are set to selected initial values. Each 
grey patch is associated with an index, and the index is 

20 incremented or decremented in accordance with a user 
selection. Parameter initialization includes dividing 
the white point's axis into n samples whose corresponding 
correlated color temperatures range between 4500**K and 
10000**K; setting a gamma value to the display's gamma 

25 value; setting phosphor values to the display's phosphor 
values; setting a current sample to a point where the 
correlated temperature is GSOO^'K; and setting the current 
index to the index of a current sample. Red green blue 
(RGB) coordinates of each grey patch are computed, each 

30 patch corresponding to one of the n sample white points. 
This computation can include assuming the white point of 
the display device corresponds to the i-th sample; 
generating a reference XYZ vector using a 7500°K 
correlated color temperature; computing an XYZ-to-RGB 
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transformation matrix based on a current white point and 
phosphor, setting; applying the XYZ-to-RGB transformation 
to the reference XYZ vector; correcting the gamma values 
5 of a reference RGB vector, using the current gamma 
values; and mapping the RGB values to a color range. 

Advantages of the invention include the following. 
The invention provides color calibration less expensively 
than color measuring equipment. Moreover, the invention 
10 is a software tool that does not require any special 

hardware besides the computer itself. Physical templates 
are not needed. The invention also obviates the need for 
matching colors in different media. The invention also 
does not require detailed knowledge of color science in 
15 order to perform color calibration. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a flow chart of a white point 
estimation process. 

Figure 2 is a flow chart of a parameter 
20 initialization process 

Figure 3 is a flow chart of an RGB coordinate 
determination process. 

Figure 4 is an illustration of a computer system. 
DESCRIPTION 

25 Referring now to Figure 1, a white point 

estimation process 100 is shown. First, the process 100 
initializes gamma and phosphor values as well as a 
current patch index (step 102), Next, the process 100 
computes RGB coordinates of the grey patches corres- 

30 ponding to n sample white points (step 104). Next, the 
process 100 displays three grey patches with indices i-1, 
i, i+1, where i is the current index (step 106), 
Ideally, the grey patches are displayed on a completely 
black screen background in the absence of any light 
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sources shining on the screen. The process 100 then 
waits for a user to select the patch appearing to have 
the most neutral grey color (step 108) . 
5 Next, the process 100 determines whether the user 

has selected a left patch (step 110) . If so, the current 
index i is decremented (step 112) and the process loops 
back to step 106. If the user has selected a right patch 
(step 114), the current index i is incremented (step 116) 

10 before the process 100 loops back to step 106. If the 
user selected the middle patch, the process 100 proceeds 
to step 118. The estimated white point is the white 
point corresponding to the current index, that is, the 
white point used to calculate the RGB coordinates of the 

15 selected grey patch. Finally, the process 100 exits 
(step 120) . In an alternative embodiment, when the 
middle patch is selected, new left and right patches are 
created from sample white points closer to the white 
point of the middle patch, until a minimum distance is 

20 reached. 

Turning now to Figure 2, the parameter 
initialization process associated with step 102 is shown 
in more detail. The process divides the white point axis 
in the chromaticity diagram into n samples whose 

25 corresponding correlated color temperatures range between 
4500°K and lOOOO^'K (step 132). Each sample is therefore 
associated with an index pointing to the array of n 
samples, a correlated color temperature T^ of the i-th 
sample, a set of chromaticity coordinates (x/, y^^) of the 

30 i-th sample at the correlated temperature T^. 

Next, the process sets a gamma parameter to the 
monitor gamma value (step 134). Then, the phosphor 
values are set to the monitor phosphor values (step 136) . 
The process of Figure 3 sets the current sample to the 
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sample with a correlated color temperature of 6500**K 
{step 138). The index is then set to the index of the 
current sample (step 140) before the process exits (step 
5 142) . 

Referring now to Figure 3, a process for 
determining the RGB coordinates of step 104 is shown in 
more detail. First, the process sets the white point to 
the point corresponding to the i-th sample (x^S y.*^) (step 

10 152). Next, the process computes a reference XYZ vector 
using the XYZ coordinates corresponding to the correlated 
color temperature of 7500^K scaled so that luminance 
value Y is set to 0.5 (step 154). For example, if the 
reference XYZ vector has the following values: 

15 X^ = 0. 9495; Y, = 1.0; and Z, = 1.2251, the scaled 

reference XYZ vector is: X^ = 0.47475; Y, = 0.5; and Z, - 
0.61255. 

Then, the process computes the XYZ-to-RGB 
transformation matrix M based on the current white point 

20 and phosphor settings (step 156) . In the XYZ to RGB 
transformation matrix, the white point chromaticity is 
denoted (w,,, Wy) , while the red, green and blue phosphors 
are denoted as (r„ r^) , (g,,, gy) and (b„ by). The Z 
values may be derived by using the equation 

25 Z = 1 - X -Y. 

Next, the following operations are performed: 

^ 1 ^ 



SUBSTITUTE SHEET (RULE 26) 



wo 99/56088 



PCT/US98/I5707 



7 - 



Sj Sy 



a= 



0 0 
0 0 
0 0 



N = G ' K: and 
M = W . 

Then, the 7500°K scaled reference XYZ vector 

r is converted into a corresponding RGB vector 
^xrz 

10 by applying the M transformation (step 158) 

C = £ • M 



Then, using the current ganuna value y, the process of 
Figure 3 corrects the gamma of the reference RGB vector 
15 Q obtained in step 158 to produce a 

RGB 
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gamma-corrected RGB vector ^/ as follows (step 
160): 

^ RGB ^RGB 

The process of Figure 3 then scales 
the gamma-corrected RGB values from the 0..1 range, which 
includes fractional values, to a range of values suitable 
for driving the display device. This is typically a 
10 range of integers from 0 to 255 for each RGB color 
component, which is calculated as follows (step 162): 

Ci' ^ = INTEGER_PART ((£.' • 255.0) + 0.5). 

RGB RGB 



INTEGER_PART is a function that truncates its argument to 
an integer value. The result is , a vector of 

RGB 

15 the gamma-corrected RGB coordinates of the grey patch for 
the current sample white point. Having calculated this, 
the process exits (step 164). 

The techniques described here may be implemented 
in hardware or software, or a combination of the two. 

20 Preferably, the techniques are implemented in computer 
programs executing on programmable computers that each 
includes a processor, a storage medium readable by the 
processor (including volatile and nonvolatile memory 
and/or storage elements), and suitable input and output 

25 devices. Program code is applied to data entered using 
an input device to perform the functions described and to 
generate output information. The output information is 
applied to one or more output devices. 
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Figure 4 illustrates one such computer system 600, 
including a CPU 610, a RAM 620, a ROM 622 and an I/O 
controller 630 coupled by a CPU bus 540. The I/O 
5 controller 630 is also coupled by an I/O bus 698 to input 
devices such as a keyboard 660 and a mouse 670, and 
output devices such as a monitor 680. The I/O controller 
630 also drives an I/O interface 690 which in turn 
controls a removable disk drive 692 such as a floppy 

10 disk, among others. 

Variations are within the scope of the following 
claims. For example, instead of using a mouse as the 
input devices to the computer system 600, a 
pressure-sensitive pen or. tablet may be used to generate 

15 the cursor position information. Moreover, each program 
is preferably implemented in a high level procedural or 
object-oriented programming language to communicate with 
a computer system. However, the programs can be 
implemented in assembly or machine language, if desired. 

20 In any case, the language may be a compiled or 
interpreted language. 

Each such computer program is preferably stored on 
a storage medium or device (e.g., CD-ROM, hard disk or 
magnetic diskette) that is readable by a general or 

25 special purpose programmable computer for configuring and 
operating the computer when the storage medium or device 
is read by the computer to perform the procedures 
described. The system also may be implemented as a 
computer-readable storage medium, * configured with a 

30 computer program, where the storage medium so configured 
causes a computer to operate in a. specific and predefined 
manner. 

The invention has been described in terms of 
particular embodiments. Other embodiments are within the 
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scope of the following claims. For example, the order of 
performing steps of the invention can be changed by those 
skilled in the art and still achieve desirable results. 
5 The number or arrangement of grey patches can be changed. 
The grey patches can be arranged in a series of steps or 
stairs. Alternatively, a series of thin grey patches or 
lines may be displayed on the screen and the user may 
select the thin grey patches or grey lines using a number 

10 of standard selection user interface. For example, the 
user can simply click on the appropriate patch or line, 
or the user may select the patch or line by scrolling a 
dial interface or bar interface, among others. The RGB 
coordinates of grey patches can be calculated as needed* 

15 The RGB coordinates of grey patches can be calculated 

using a reference vector having a color temperature other 
than 7500°K. The iteration to a final selection by the 
user of a neutral grey patch can include changing the 
amount by which the displayed grey patches differ from 

20 each other as the process converges to a neutral grey 
color- 
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What is claimed is: 

1. A method for estimating a white point, comprising: 
displaying a plurality of grey patches on a display 

screen of a display device; 
5 requesting that a user select one of the plurality of 

grey patches having a neutral grey color; and 

iterating the steps of displaying grey patches and 
requesting user selection to converge to a grey patch 
where the estimated white point is the most neutral grey 
10 point. 

2. The method of claim 1, further comprising: 
dividing a white point axis of a chromaticity diagram 

into n samples whose corresponding correlated color 
temperatures range between 4500**K and 10000°K; 
15 setting a gamma value to the display's gamma value; 

setting phosphor values to the display's phosphor 
values; 

setting a current sample to a point where the 
correlated temperature is 6500°K; and 
20 displaying a current grey patch according to the 

gamma and phosphor values and the current sample. 

3. The method of claim 1 or 2, further comprising 
computing red green blue (RGB) coordinates of a grey 
patch corresponding to one of n sample white points on a 

25 chromaticity diagram. 

4. The method of claim 1, 2, or 3, wherein computing RGB 
coordinates of a grey patch comprises: 

initializing gamma and phosphor values; 

selecting a current white point corresponding to an 
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i-th sample of n sample white points on a chromaticity 
diagraia; 

generating a reference XYZ vector using a 7500®K 
correlated color temperature; 



current white point and phosphor values; 

applying the XYZ-to-RGB transformation to the 
reference XYZ vector to create a reference RGB vector; 

applying a gamma correction to the reference RGB 
10 vector; and 

mapping the gamma-corrected RGB values to a range of 
values suitable for driving the display device. 

5. The method of claim 4, further comprising: 

scaling the XYZ reference vector to have a luminance 
15 value Y in a range between 0 and 1 before creating the 
reference RGB vector. 

6- The method of claim 1, 2, or 3, wherein a white point 
chromaticity is denoted (w^, Wy) , values for red, green 
and blue phosphors are denoted (r^, ry) , (g^, gy) and 
20 {b^, by) , and Z has a value 1-X-Y, the method further 
comprising: 



5 



computing an XYZ-to-RGB transformation based on the 



determining 
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r T r 

X y 2 



Sx Sy 

b b b , 



determining 



determining 



determining 



0 0 

0 0 
0 0 V. 



determining N = G • K ; 
determining W = N ; and 
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converting a 7500°K scaled reference XYZ vector Cj^^j 
into a vector of RGB coordinates Crgb in accordance with 

C = C -M . 

—RGB —XYZ ^ 



7. The method of claim 1, 2, 3, or 6, wherein the grey 
patches are displayed on a black screen background in the 

5 absence of light shining on the screen. 

8. A computer program stored on a computer-readable 
medium for estimating a white point, the program 
comprising instructions to: 

display a plurality of grey patches on a display 
10 screen of a display device; 

request that a user select one of the plurality of 
grey patches having a neutral grey color; and 

iterate the steps of displaying grey patches and 
requesting user selection to converge to a patch where 
15 the estimated white point is the most neutral grey point. 

9. The program of claim 8, further comprising 
instructions to: 

divide the white point axis of a chromaticity diagram 
into n samples whose corresponding correlated color 
20 temperatures range between 4500**K and 10000**K; 

set a gamma value to the display's gamma value; 
set phosphor values to the display's phosphor values; 
set a current sample to a point where the correlated 
temperature of 6500*K; and 
25 display a current grey patch according to the gamma 
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and phosphor values and the current sample, 

10- The program of claim 8 or 9, further comprising 
instructions to compute red green blue (RGB) coordinates 
of a grey patch corresponding to one of n sample white 
5 points on a chromaticity diagram. 

11. The program of claim 8, 9, or 10, wherein the RGB 
coordinate computing instructions further comprises 
instructions to: 

initialize gamma and phosphor values; 
10 select a current white point corresponding to an i-th 

sample of n sample white points on a chromaticity 
diagram; 

generate a reference XYZ vector using a 7500**K 
correlated color temperature; 
15 compute an XYZ-to-RGB transformation based on the 

current white point and phosphor values; 

apply the XYZ-to-RGB transformation to the reference 
XYZ vector to create a reference RGB vector; 

apply a gamma correction to the reference RGB vector; 

20 and 

map the gamma -corrected RGB values to a range of 
values suitable for driving the display device. 

12. The program of claim 11, further comprising 
instructions to: 

25 scale the XYZ reference viector to have a luminance 

value Y = 0.5 before creating the reference RGB vector. 

13. The program of claim 8, 9, or 11, wherein a white 
point chromaticity is denoted (w^., Wy) , values for red, 
green and blue phosphors are denoted as (r^, ry) , (g^,, gy) 
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and (b,., by) , and Z values generated as 1 
comprising instructions to: 
determine 



X -Y, further 



W = [X Y Z] ^ 



^ 1 ^ 



w 



deteirmine 



r r r 

z y z 



Sx 

b b b , 



determine 



determine 



determine 
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V. 0 0^ 



G= 



O K 0 
0 0 K 



determine W G • K ; 
determine M = N ; and 

convert a 7500**K scaled reference XYZ vector C^yj 
into a vector of RGB coordinates C^^^ in accordance with 



5 14. The program of claim 8, 9, 10, or 13, wherein the 
grey patches are displayed on a black screen background 
in the absence of light shining on the screen. 

15. In a system having a display device with a display 
screen, a subsystem for estimating a white point, 
10 comprising: 

means for displaying a plurality of grey patches on 
the display screen of the display devices- 
means for requesting that a user select one of the 
plurality of grey patches having a neutral grey color; 
15 and 

means for iteratively displaying grey patches and 
requesting user selections to converge to a grey patch 
where the estimated white point is the most neutral grey 
point . 
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IS. The system of claim 15, further comprising: 

means for dividing a white point axis of a 
chromaticity diagram into n samples whose corresponding 
correlated color temperatures range between 4 500*'K and 
5 10000°K; 

means for setting a gamma value to the display' s 

gamma valued- 
means for setting phosphor values to the display's 

phosphor values; 
10 means for setting a current sample to a point where 

the correlated temperature is 6500°K; and 

means for displaying a current grey patch according 

to the gamma and phosphor values and the current sample, 

17. The system of claim 15 or 16, further comprising 

15 means for computing red green blue (RGB) coordinates of a 
grey patch corresponding to one of n sample white points 
on a chromaticity diagram. 

18. The system of claim 15, 16, or 17, wherein computing 
RGB coordinates of a grey patch comprises: 

20 means for initializing gamma and phosphor setting 

values; 

means for selecting a current white point 
corresponding to an i-th sample of n sample white points 
on a chromaticity diagram; 
25 means for generating a reference XYZ vector using a 

7500°K correlated color temperature; 

means for computing an XYZ-to-RGB transformation 
based on the current white point and phosphor values; 

means for applying the XYZ-to-RGB transformation to 
30 the reference XYZ vector to create a reference RGB 
vector; 
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means for applying a gamma correction to the 
reference RGB vector; and 

means for mapping the gamma-corrected RGB values to a 
range of values suitable for driving the display device. 

5 19. The system of claim 18, further comprising: 

means for scaling the XY2 reference vector to have a 
luminance value Y 0.5 before creating the reference RGB 
vector. 

20- The system of claim 15, 16, or 17, wherein a white 
10 point chromaticity is denoted (w^,, Wy) , values for red, 

green and blue phosphors are denoted (r^, ry) , (g^, gy) and 
(b,, by) , and Z has a value 1-X-Y, the system further 
comprising: 



15 vector Cxy^ into a vector of RGB coordinates in 
accordance with = Cxvz-M, where M is calculated in 
accordance with the following equations: 



means for converting a 7500**K scaled reference XY2 




\ 



r 



r 



z 



y 



z 



K = 




20 
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a = 



0 0 
0 0 
0 0 K 



and 



5 21. The system of claim 15, 16, 17, or 20, wherein the 
grey patches are displayed on a black screen background 
in the absence of light shining on the screen. 

22. A method for estimating a white point of a display 
device, comprising: 

10 displaying an image on a screen of a display devices- 

deriving an estimate of the white point of the 
display device solely on the basis of a user's response 
to the displayed image and without comparison to an 
external reference, the estimate of the white point being 

15 the coordinates of the estimate on a chromaticity 
diagram. 
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23. The method of claim 22 wherein the white point 
estimate coordinates are XYZ values in a CIE chromaticity 
diagram. 
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